Image processing device that generates a composite image

ABSTRACT

An image capture device ( 1 ) includes an image acquiring unit ( 71 ), image specifying unit ( 72 ), image selecting unit ( 73 ), and combined image generating unit ( 74 ). The image acquiring unit ( 71 ) acquires data of a plurality of images indicative of a sequence of actions of an object. The image specifying unit ( 72 ) specifies a partial predetermined action in the sequence of the actions of the object from the plurality of images acquired by the image acquiring unit ( 71 ). The image selecting unit ( 73 ) selects data of a plurality of images corresponding to the predetermined action from among the data of the plurality of images based on a specifying result by the image specifying unit ( 72 ). The composite image generating unit ( 74 ) generates one composite image from the data of a plurality of images selected by the image selecting unit ( 73 ).

This application is based on and claims the benefit of priority fromJapanese Patent Application No. 2012-064529, filed on 21 Mar. 2012, thecontent of which is incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing device thatgenerates a composite image, an image processing method, and a storagemedium.

2. Related Art

Conventionally, actions of an object captured in a moving image arephotographed by an image capture device such as a digital camera andused for subsequent checking. For example, for sports such as golf, aswing action is recorded as a moving image and the data of the swing isused for subsequent checking.

The technology described in Japanese Unexamined Patent Application,Publication No. H11-98450 has been known as technology for such checkingswing form. The technology disclosed in Japanese Unexamined PatentApplication, Publication No. H11-98450 is technology for combining asequence of swing actions of a golf club head into a single static imageto display.

SUMMARY OF THE INVENTION

An image processing device according to one aspect of the presentinvention includes: an image acquiring unit that acquires a plurality ofimages indicative of a sequence of actions of an object; an imagespecifying unit that specifies a predetermined partial action in thesequence of the actions of the object from the plurality of imagesacquired by the image acquiring unit; an image selecting unit thatselects a plurality of images corresponding to the predetermined partialaction from among the plurality of images, based on a specifying resultby the image specifying unit; and a composite image generating unit thatgenerates a composite image from the plurality of images selected by theimage selecting unit.

An image processing method according to one aspect of the presentinvention is an image processing method executed by an image processingdevice, and the method includes the steps of: acquiring a plurality ofimages indicative of a sequence of the actions of an object; specifyinga predetermined partial action during the sequence of an action of theobject from the plurality of images acquired by the image acquiringunit; selecting a plurality of images corresponding to the predeterminedpartial action from among the plurality of images, based on a specifyingresult by the image specifying unit; and generating a composite imagefrom the plurality of images selected by the image selecting unit.

A storage medium encoded with a computer-readable program according toone aspect of the present invention enables a computer to executefunctions as: an image acquiring unit that acquires a plurality ofimages indicative of a sequence of actions of an object; an imagespecifying unit that specifies a predetermined partial action during thesequence of an action of the object from the plurality of imagesacquired by the image acquiring unit; an image selecting unit thatselects a plurality of images corresponding to the predetermined partialaction from among the plurality of images, based on a specifying resultby the image specifying unit; and a composite image generating unit thatgenerates a composite image from the plurality of images selected by theimage selecting unit.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a hardware configuration of animage capture device according to an embodiment of an image processingdevice of the present invention;

FIG. 2 is a functional block diagram illustrating a functionalconfiguration for executing composite image generating processing amongthe functional configurations of the image capture device of FIG. 1;

FIG. 3 is a schematic view illustrating an example of a completecomposite image generated by the composite image generating processing;

FIGS. 4A to 4F are a schematic view illustrating an example of a partialcomposite image;

FIG. 5 is a view illustrating an example of a selection screen of apartial composite image displayed on a output unit of the image capturedevice; and

FIG. 6 is a flowchart illustrating a flow of composite image generatingprocessing executed by the image capture device of FIG. 3 having thefunctional configuration of FIG. 2.

DETAILED DESCRIPTION OF THE INVENTION

In the following, embodiments of the present invention are explainedwith reference to the drawings.

FIG. 1 is a block diagram illustrating a hardware configuration of animage capture device according to an embodiment of an image processingdevice of the present invention.

The image capture device 1 is configured as, for example, a digitalcamera.

The image capture device 1 includes a CPU (Central Processing Unit) 11,ROM (Read Only Memory) 12, RAM (Random Access Memory) 13, an imageprocessing unit 14, a bus 15, an input/output interface 16, an imagecapture unit 17, an input unit 18, an output unit 19, a storage unit 20,a communication unit 21, and a drive 22.

The CPU 11 executes various processing in accordance with programsstored in the ROM 12, or programs loaded from the storage unit 20 intothe RAM 13.

The RAM 13 stores the necessary data and the like upon the CPU 11executing various processing, as appropriate.

The CPU 11, the ROM 12, and the RAM 13 are connected to each other viathe bus 15. The input/output interface 16 is also connected to the bus15. The image capture unit 17, the input unit 18, the output unit 19,the storage unit 20, the communication unit 21, and the drive 22 arealso connected to the input/output interface 16.

The image capture unit 17 (not illustrated) includes an optical lensunit and an image sensor.

The optical lens unit is configured by a lens that condenses light inorder to capture an image of a subject, e.g., a focus lens, zoom lens,etc.

The focus lens is a lens that causes a subject image to form on a lightreceiving surface of an image sensor. The zoom lens is a lens thatcauses the focal length to freely change in a certain range.

Peripheral circuits that adjust the setting of parameters such as focus,exposure, white balance, etc. are also provided to the optical lens unitas necessary.

The image sensor is configured from photoelectric conversion elements,AFE (Analog Front End), etc.

The photoelectric conversion elements are configured from CMOS(Complementary Metal Oxide Semiconductor)-type photoelectric conversionelements. A subject image is reflected from the optical lens unit in thephotoelectric conversion elements. Therefore, the photoelectricconversion elements performs photoelectric conversion of a subject image(captures an image), accumulates image signals for a certain timeperiod, and sequentially supplies the image signals thus accumulated toan AFE as analog signals.

The AFE conducts various signal processing such as A/D (Analog/Digital)conversion processing on these analog image signals. Digital signals aregenerated through various signal processing and outputted as outputsignals of the image capture unit 17.

Such output signals of the image capture unit 17 are hereinafter called“captured image data”. The captured image data is supplied to the CPU11, the image processing unit 14, and the like as appropriate.

The input unit 18 is configured by various buttons and the like, andinputs various information in accordance with a user's operations.

The output unit 19 is configured by a display, a speaker, and the likeand outputs images and sounds.

The storage unit 20 is configured by a hard disk, DRAM (Dynamic RandomAccess Memory), or the like, and stores various image data.

The communication unit 21 controls communications with other devices(not illustrated) via networks including the Internet.

A removable media 31 made from a magnetic disk, optical disk,magneto-optical disk, semiconductor memory, or the like is installed inthe drive 22 as appropriate. The programs read from the removable media31 by the drive 22 are installed in the storage unit 20 as necessary. Inaddition, similarly to the storage unit 20, the removable media 31 canalso store various data such as the image data stored in the storageunit 20.

FIG. 2 is a functional block diagram illustrating a functionalconfiguration for executing composite image generating processing amongthe functional configurations of the image capture device of FIG. 1.

The composite image generating processing refers to a sequence ofprocessing of analyzing a moving image based on data of the movingimages acquired, specifying an action of an object captured in themoving image, combining static images corresponding to the action thusspecified (a complete composite image or a partial composite image asdescribed later) to display, etc.

In the present embodiment, an example is described in which the imagecapture device 1 captures a target performing a golf swing as an object.

It should be noted that, in the present embodiment, actions of theobject captured is specified as a sequence of actions (hereinafter,referred to as “entire action”) as well as partial series of actionsthat constitute a part of the sequence of actions (hereinafter, referredto as “partial action”).

In other words, in the present embodiment that captures a golf swing andgenerates a composite image, the entire action corresponds to a sequenceof actions of a swing and partial actions correspond to each actionconstituting a swing (for example, address, backswing, top, downswing,impact, follow-through, and finish).

In a case of the composite image generating processing being executed,as shown in FIG. 2, an image capture control unit 51 and an outputcontrol unit 52 function in the CPU 11, and an image acquiring unit 71,an image specifying unit 72, an image selecting unit 73, and a compositeimage generating unit 74 function in the image processing unit 14.

However, FIG. 2 is merely an example, and at least a part of thefunctions of the CPU 11 may be transferred to the image processing unit14, or conversely, at least a part of the functions of the imageprocessing unit 14 may be transferred to the CPU 11.

In this case, an acquired image storing unit 91 that is provided as anarea of the storage unit 20 and a composite image storing unit 92 areused.

In the acquired image storing unit 91, captured image data outputtedfrom the image capture unit 17 and acquired by the image acquiring unit71 is stored.

In the composite image storing unit 92, composite image data outputtedfrom the composite image generating unit 74 is stored.

The image capture control unit 51 sets various image capture conditionsand controls an operation of image capturing at the image capture unit17.

In the present embodiment, the image capture control unit 51 causes theimage capture unit 17 to capture a moving image in order to capture anaction of an object.

The output control unit 52 controls the output unit 19 so as to outputto display the composite image (a complete composite image or a partialcomposite image as described later) stored in the composite imagestoring unit 92.

The image acquiring unit 71 acquires data of a moving image outputtedfrom the image capture unit 17 as data acquirable as a plurality ofsingle images (static images) that is data of a plurality of imagesshowing a sequence of actions. Then, the image acquiring unit 71 storesdata of the moving image acquired in the acquired image storing unit 91.

The image specifying unit 72 performs image specifying to specify anaction of an object captured in single images. Furthermore, the imagespecifying unit 72 associates the action thus specified with a singleimage. More specifically, the image specifying unit 72 acquires data ofthe moving image from the acquired image storing unit 91 and specifiesan action of the object captured in the single images constituting themoving image. Then, the image specifying unit 72 associates an action ofthe object thus specified with a corresponding single image, and storesin the acquired image storing unit 91. In the present embodiment, theimage specifying unit 72 specifies the actions of a swing forming anentire action and the actions constituting a swing (for example,address, backswing, top, downswing, impact, follow through, and finish)from an action of a human and an action of a club (specifically, anaction of a club head).

Regarding a method for specifying a partial action belonging to anaction of an object, it is not particularly limited, and for example, amethod of specifying a partial action by estimating the partial actionbased on a swing time may be used, or a method of an image matchingtechnology which specifies a partial action by comparison with areference image may be used. Furthermore, a method of extracting data ofa club or a club head from an image and specifying a partial action of aswing from the positional relationship of the club or the club head thusextracted may be used.

Regarding methods of specifying partial actions belonging to an actionof such an object, any publicly known or other methods in the future,for example, the methods disclosed in Japanese Unexamined PatentApplication, Publication No. 2008-278386, Japanese Unexamined PatentApplication, Publication No. 2009-53786, and Japanese Patent No.4415198, for example, may be employed.

The image selecting unit 73 selects a plurality of single imagesspecified based on an instruction of image combination from the inputunit 18. More specifically, the image selecting unit 73 selects singleimage data, which corresponds to a designated action, constituting amoving image stored in the acquired image storing unit 91, based on aninstruction of combination of a complete composite image or a partialcomposite image as described later from the input unit 18.

The composite image generating unit 74 combines single images selectedby the image selecting unit 73 and generates composite image data.

In a case of single images corresponding to a sequence of actions of aswing being selected as an entire action by the image selecting unit 73,the composite image generating unit 74 generates data of an image madeby combining single images capturing a swing to form a single staticimage (hereinafter, referred to as “complete composite image”).

Furthermore, in a case of single images corresponding to a partialaction of a swing (for example, a downswing) being selected by the imageselecting unit 73, the composite image generating unit 74 generates dataof an image made by combining single images capturing the downswing toform a single static image (hereinafter, referred to as “partialcomposite image”). It should be noted that, in the present embodiment, apartial composite image is combined to include single imagescorresponding to a partial action and single images corresponding tolocations that are temporally before and after the partial action. Inother words, in a case of generating data of a partial composite imageof the partial action of the downswing, single images in which an actionbefore and after the downswing (an action during top and downswing andan action during downswing and impact) are captured are combined.

Furthermore, upon generating a partial composite image, the compositeimage generating unit 74 can combine only a main portion of an action(for example, a club head or ball). In other words, in order to clearlyshow a trajectory of an action on an image that best represents anaction selected, the composite image generating unit 74 can combine apart having a movement into the images before and after the image bestrepresenting the action selected.

By combining the data of the partial composite image in this way, it ispossible to provide a clear image in which an action of an object can beeasily recognized.

That is to say, the composite image generating unit 74 generates data ofa complete composite image based on an instruction of combination of acomplete composite image, and generates data of a partial compositeimage based on an instruction of combination of a partial compositeimage by designating a predetermined action by the input unit 18.

Next, an example of the complete composite image generated by thecomposite image generating processing is explained with reference toFIG. 3.

FIG. 3 is a schematic view illustrating an example of a completecomposite image generated by the composite image generating processing.

In the example of FIG. 3, data of an entire image is generated from dataof a moving image captured from behind a subject that is swinging.

Since the complete composite image is composed of images in which all ofactions corresponding to a sequence of actions of a swing are captured,it is formed to be such an image in which partial actions constituting aswing are captured like residual images. In other words, in the presentembodiment, the complete composite image is an image in which all of theobjects having an action (a swinging subject 100, a club head 101, aclub including a club shaft 102, etc.) are combined.

In a case of a golf swing, actions (a trajectory) of a club from theaddress to the backswing and actions (a trajectory) of a club from thetop to the impact through the downswing during the actions from the topto the finish are substantially the same.

Furthermore, in a case of capturing a subject that is swinging frombehind, a trajectory from the address to the impact and a trajectoryfrom the impact to the finish are substantially the same.

Therefore, although a user checking a complete composite image can knowthe actions of an entire swing, it is difficult to know what portion ofthe entire swing the partial actions respectively correspond to.

Therefore, the image capture device 1 of the present embodiment picks uppartial actions only as partial composite images and generates an imagethat can be displayed.

Next, an example of a partial composite image generated by the compositeimage generating processing is explained with reference to FIGS. 4A to4F.

FIGS. 4A to 4F are a schematic view illustrating an example of a partialcomposite image generated by the composite image generating processing.

FIGS. 4A to 4C are schematic views illustrating an example of a partialcomposite image corresponding to the downswing, impact, andfollow-through in a case of capturing actions of a swing from behind theswinging subject 100.

Regarding the examples of FIGS. 4A to 4C, as compared to the example ofFIG. 3 in which the actions of the swing changes in a depth direction ofthe image, the movement can be easily recognized since the actions ofthe swing changes in a planar direction with respect to the swingingsubject 100.

Furthermore, the examples of FIGS. 4A to 4C are combined to includeactions before and after a designated action, and are combined to mainlyinclude the club head 101 and a ball 103 only. In other words, for theswinging subject 100, only a designated action (for example, an actionof the impact for FIG. 4B) is combined. By combining in this way, it ispossible to easily recognize the partial action that is designated whilealso enabling a sequence of the partial actions to be recognized.

By combining the partial actions only in this way, a formed image doesnot become cumbersome even in a case of actions of drawing overlappingtrajectories.

Furthermore, FIGS. 4D to 4F are schematic views illustrating an exampleof a partial composite image corresponding to the downswing, impact, andfollow-through in a case of capturing actions of a swing from a frontside of the swinging subject 100.

The examples of FIGS. 4D to 4F are formed by combining partial actionscorresponding to FIGS. 4A to 4C as partial composite images.

It should be noted that the movements of the club head 101 and the ball103 are mainly focused in the examples of FIGS. 4D to 4F and it isconfigured such that a trajectory other than those of the club head 101and the ball 103 are displayed the least. In other words, in the exampleof FIGS. 4D to 4F, for the swinging subject 100, the club shaft 102, andthe like, only one predetermined partial action is configured to bedisplayed with maximum clarity, and, for the club head 101 and the ball103, all of the partial actions are configured to be displayed. In otherwords, in a case of a predetermined action being selected, the swingingsubject 100, the club shaft 102, and the like that are captured in oneimage constituting the predetermined action are employed, and, for theclub head 101, the ball 103, and the like, an image in which all ofpredetermined actions are captured is employed. In other words, an imageis generated in which the swinging subject 100, the club shaft 102, andits background do not move and the club head 101, the ball 103, and thelike move since a plurality of images are combined.

Various publicly known methods can be employed for a specific methodhere. For example, it is possible to extract the swinging subject 100,the club (the club head 101 and club shaft 102), and the ball 103 asobjects in the image, adopt only the swinging subject 100 and the clubshaft 102 from one image, and adopt the club head 101, the ball 103, andthe like from an image of a predetermined action range.

Furthermore, although single images are combined with equal intervals inthe example of FIGS. 4D to 4F, the present invention is not limitedthereto, and intervals of the images upon combining may be changeddepending on an action speed or in accordance with a designated part.

Next, an example of switching a display from a complete composite imageto a partial composite image is explained with reference to FIG. 5.

FIG. 5 is a view illustrating an example of a selection screen of apartial composite image displayed on the output unit 19 of the imagecapture device. In the image capture device 1 of the present embodiment,software buttons B1 to B3 by which a partial image as shown in FIG. 5can be selected appear after displaying a complete composite image. Uponselecting either of the software buttons B1 to B3, a partial compositeimage corresponding to the software buttons B1 to B3 thus selected canbe generated and displayed.

In the example of FIG. 5, the software buttons (a “FS” button, an “IP”button, and a “DS” button) are displayed on the complete compositeimage. By a user selecting either of the software buttons by performinga touch operation thereon or operating the input unit 18, the imagecapture device 1 generates and displays a partial composite imagecorresponding to a software button selected.

It should be noted that the “FS” button is a software button forgenerating a partial composite image corresponding to an action of thefollow-through and instructing to display it. The “IP” button is asoftware button for generating a partial composite image correspondingto an action of the impact and instructing to display it. The “DS”button is a software button for generating a partial composite imagecorresponding to an action of the downswing and instructing to displayit.

A partial image of a corresponding action may be generated by touchingor selecting an object.

Next, composite image generating processing executed by the imagecapture device 1 of FIG. 1 having the functional configurations of FIG.2 is explained with reference to the flowchart of FIG. 6. It should benoted that, in the present example, an example is explained in whichdata of a complete composite image is generated and, after displayingit, data of the partial composite image of the follow-through isgenerated and displayed.

FIG. 6 is a flowchart illustrating an example of a flow of the compositeimage generating processing executed by the image capture device of FIG.1 having the functional configurations of FIG. 2.

When a start of the composite image generating processing is instructedby a predetermined operation by the user on the input unit 18, thecomposite image generating processing starts and executes the followingprocessing.

In Step S1, the image acquiring unit 71 acquires data of a moving imageas data of a plurality of images showing a sequence of actions. Morespecifically, upon receiving an input for the start of image capturefrom the input unit 18, the image capture control unit 51 startscapturing at the image capture unit 17. Then, the image acquiring unit71 acquires data of the moving image captured by the image capture unit17. Furthermore, the image acquiring unit 71 stores data of the movingimage thus acquired in the acquired image storing unit 91.

In Step S2, the image specifying unit 72 analyzes data of the movingimage. In other words, the image specifying unit 72 analyzes data ofsingle images constituting the data of the moving image. The analysis ofthe data of the single images is performed by specifying an action of anobject captured in the single images.

More specifically, the image specifying unit 72 specifies that an actionof an object captured in single images constituting a moving imagebelongs to the downswing, for example.

In Step S3, the image specifying unit 72 associates the single imageswith a specifying result.

More specifically, the image specifying unit 72 stores data indicating apartial action specified in Step S2 with data of the single images to beassociated in the acquired image storing unit 91.

In Step S4, the composite image generating unit 74 combines all of thesingle images and generates data of a complete composite image. Morespecifically, all of the single images are selected by the imageselecting unit 73, and the composite image generating unit 74 combinesall of the single images thus selected into one static image andgenerates data of the complete composite image.

In Step S5, the output unit 19 displays the complete composite image.More specifically, the output unit 19 controls so as to output anddisplay the complete composite image by the output control unit 52. As aresult thereof, the complete composite image in which all of the singleimages constituting the moving image as shown in FIG. 3 is displayed atthe output unit 19.

In Step S6, the image selecting unit 73 selects data of the singleimages corresponding to a partial action designated. More specifically,in a case in which a partial action is designated as shown in FIG. 5 bythe user operating the input unit 18, the image selecting unit 73selects the data of the single images corresponding to the partialaction thus designated that is stored in the acquired image storing unit91, from the acquired image storing unit 91 to be stored.

During this, in the example shown in FIG. 5, the software button B1 of“FS” is touched and the single images corresponding to thefollow-through corresponding to the software button B1 of “FS”.

In Step S7, the composite image generating unit 74 combines the singleimages thus selected and generates data of the complete composite image.More specifically, all of the single images are selected by the imageselecting unit 73, and the composite image generating unit 74 combinesall of the single images thus selected and generates data of thecomplete composite image.

The composite image generating unit 74 acquires the single imagescorresponding to the follow-through thus selected from the acquiredimage storing unit 91, combines all of the single images correspondingto the follow-through, and generates data of a partial composite imagecorresponding to a partial action of the follow through.

During this, although all of the single images corresponding to thefollow-through designated are acquired, single images corresponding topartial actions before and after the follow-through are furtheracquired.

In Step S8, the output unit 19 displays the partial composite image.More specifically, the output unit 19 controls so as to output todisplay the partial composite image by the output control unit 52. As aresult thereof, the partial composite image in which the single imagescorresponding to the action of the follow-through, as shown in FIG. 4C,is displayed at the output unit 19.

Furthermore, in Step S6, by changing a designation of the partialaction, for example, by the software button B2 of “IP” being touched, apartial composite image corresponding to an action of the impact asshown in FIG. 4B is displayed.

By capturing an object from the front side thereof, it is possible togenerate and display a partial composite image of an actioncorresponding to the downswing as shown in FIG. 4D, a partial compositeimage of an action corresponding to the impact as shown in FIG. 4E, apartial composite image of an action corresponding to the follow-throughas shown in FIG. 4F, etc., for example.

In this way, the composite image generating processing ends afterdisplaying the partial composite image in the processing of Step S8.

The image capture device 1 executing the above such composite imagegenerating processing includes the image acquiring unit 71, the imagespecifying unit 72, the image selecting unit 73, and the composite imagegenerating unit 74.

The image acquiring unit 71 acquires data of a plurality of imagesshowing an action of an object.

The image specifying unit 72 specifies a partial action constituting theactions of an object from a plurality of images acquired by the imageacquiring unit 71.

The image selecting unit 73 selects data of an image corresponding to apredetermined partial action from among the data of the plurality ofimages based on a specifying result by the image specifying unit 72.

The composite image generating unit 74 generates one composite imagefrom the data of a plurality of images selected by the image selectingunit 73.

Therefore, in the image capture device 1, one composite image isgenerated from the data of an image corresponding to a predeterminedpartial action from among the data of a plurality of images selectedbased on a specifying result by the image specifying unit 72.

Therefore, in the image capture device 1, it is possible to generate animage in which a specified partial action in an action of an object canbe easily recognized. Furthermore, since the image generated onlyincludes a specified partial action, the image does not becomeunrecognizable.

Furthermore, the image selecting unit 73 selects data of imagescorresponding to at least either of an action before or after apredetermined partial action, in addition to the data of imagescorresponding to the predetermined partial action.

Therefore, in the image capture device 1, since an image is combined bysimply including the action before or after the parts corresponding to apredetermined partial action, the image includes the data of atrajectory to reach a predetermined partial action, a trajectoryfollowing a trajectory of a predetermined part, and the like, it ispossible to easily understand a trajectory of a partial action.

It is to be noted that the present invention is not limited to theabove-described embodiment and modifications, improvements, and thelike, that fall within the range in which the object of the presentinvention can be achieved are included in the present invention.

In the abovementioned embodiment, although the image acquiring unit 71acquires a plurality of images including actions of an object capturedby the image capture device 1, the present invention is not limitedthereto. So long as the data of images acquired is a plurality of dataincluding a sequence of actions, for example, not limited to a movingimage, it may be a static image, or may be an image acquired externallythat is not captured by the image capture unit.

Furthermore, in the abovementioned embodiment, although the compositeimage (the complete composite image or the partial composite image) iscombined regardless of an action speed, the present invention is notlimited thereto. For example, in a composite image, it may be configuredsuch that images are thinned out and composite for a slow part of anaction, and captured images are interpolated for a fast part of anaction. With such a configuration, it is possible to provide an image inwhich the trajectory of a partial action can be easily recognized.

Although the present invention is described using, as an example, a golfswing as a sequence of actions in the above-described embodiment, thepresent invention is not limited thereto. For example, although anaction including a repetitive movement is preferable as a sequence ofactions, the present invention is not limited thereto, not limited toactions in sports such as ball games such as baseball and tennis, ormartial sports such as Kendo, and Judo, and not limited to a sequence ofregularly defined actions. It is acceptable so long as being a compositeimage in which a partial action for which easy recognition has beenfacilitated and the image itself has not been made unrecognizable, byextracting a partial action of a sequence of actions.

Although in the above-described embodiment the imaging apparatus 1 towhich the present invention is applied is described using, as anexample, a digital camera, the present invention is not particularlylimited thereto.

For example, the present invention can be applied to electronicequipment in general having a composite image generation function.Specifically, for example, the present invention can be applied tonotebook personal computers, printers, television receivers, videocameras, portable navigation apparatuses, mobile phones, portable gamemachines, etc.

The above-described series of processes can be performed by hardware orcan be performed by software.

In other words, the functional configurations shown in FIG. 2 are merelyillustrative and thus are not particularly limited. Namely, it issufficient that the imaging apparatus 1 have a function capable ofperforming the above-described series of processes as a whole, and whatfunctional blocks are used to implement the function are notparticularly limited to the examples in FIG. 2.

A single functional block may be configured by hardware alone or may beconfigured by software alone or may be configured by a combinationthereof.

When a series of processes are performed by software, a programconstituting the software is installed on a computer, etc., via anetwork or from a recording medium.

The computer may be a computer incorporated in dedicated hardware.Alternatively, the computer may be a computer capable of performingvarious functions by installing various programs, e.g., ageneral-purpose personal computer.

A recording medium including such a program is not only configured bythe removable media 31 in FIG. 1 which is distributed separately fromthe apparatus main body in order to provide a user with the program, butis also configured by, for example, a recording medium which is providedto the user, incorporated in advance in the apparatus main body. Theremovable media 31 is configured by, for example, a magnetic disk(including a floppy disk), an optical disk, a magneto-optical disk, orthe like. The optical disk may be configured by, for example, a CD-ROM(Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), or thelike. The magneto-optical disk is configured by an MD (Mini-Disk) or thelike. The recording medium which is provided to the user, incorporatedin advance in the apparatus main body is configured by, for example, theROM 12 in FIG. 1 having a program recorded therein, a hard disk includedin the storage unit 20 in FIG. 1, or the like.

Note that in the specification the steps describing a program recordedin a recording medium not only include processes that are performed inthe order of the steps in a time-series manner, but also includeprocesses that are not necessarily processed in a time-series manner butare performed in parallel or individually.

Although the embodiment of the present invention has been describedabove, the embodiment is merely illustrative and do not limit thetechnical scope of the present invention. The present invention canemploy various other embodiments, and furthermore, various changes suchas omission and replacement may be made therein without departing fromthe true spirit of the present invention. These embodiments andmodifications thereto are included in the true scope and spirit of thepresent invention described in the specification, etc., and are includedin the inventions described in the appended claims and in the range ofequivalency of the inventions.

What is claimed is:
 1. An image processing device comprising: an imageacquiring unit that acquires a plurality of images indicative of asequence of actions of an object; an image specifying unit thatspecifies a predetermined partial action in the sequence of the actionsof the object from the plurality of images acquired by the imageacquiring unit; an image selecting unit that selects a plurality ofimages corresponding to the predetermined partial action from among theplurality of images, based on a specifying result by the imagespecifying unit; and a composite image generating unit that generates acomposite image from the plurality of images selected by the imageselecting unit.
 2. The image processing device according to claim 1,wherein the image selecting unit selects images corresponding to eitherof an action before or after the predetermined action, in addition toimages corresponding to the predetermined action.
 3. The imageprocessing device according to claim 1, wherein the image acquiring unitacquires images in which a golf swing is captured as the sequence of theactions of the object.
 4. The image processing device according to claim1, wherein the image acquiring unit acquires the plurality of images asa moving image.
 5. An image processing method executed by an imageprocessing device, the method comprising the steps of: acquiring aplurality of images indicative of a sequence of actions of an object;specifying a predetermined action in the sequence of the actions of theobject from the plurality of images acquired by the image acquiringunit; selecting a plurality of images corresponding to the predeterminedpartial action from among the plurality of images, based on a specifyingresult by the image specifying unit; and generating a composite imagefrom the plurality of images selected by the image selecting unit.
 6. Astorage medium encoded with a computer-readable program that enables acomputer to execute functions as: an image acquiring unit that acquiresa plurality of images indicative of a sequence of actions of an object;an image specifying unit that specifies a predetermined partial actionin the sequence of the actions of the object from the plurality ofimages acquired by the image acquiring unit; an image selecting unitthat selects a plurality of images corresponding to the predeterminedpartial action from among the plurality of images, based on a specifyingresult by the image specifying unit; and a composite image generatingunit that generates a composite image from the plurality of imagesselected by the image selecting unit.